chore: add benchmarks history tracking by cdc-as81 · Pull Request #765 · CDCgov/ixa

cdc-as81 · 2026-02-11T17:22:56Z

No description provided.

github-actions · 2026-02-11T17:41:58Z

Benchmark Results

Hyperfine

Command	Mean [ms]	Min [ms]	Max [ms]	Relative
`large_sir::baseline`	2.3 ± 0.1	2.2	2.8	1.00
`large_sir::entities`	9.9 ± 0.1	9.8	10.5	4.28 ± 0.19

Criterion

Regressions:
  Group                                  Bench                                                              Change  CI Lower  CI Upper
  -------------------------------------  ----------------------------------------------------------------  -------  --------  --------
  sampling                               sampling_multiple_known_length_entities                            1.102%    1.011%    1.178%
  indexing                               query_people_multiple_individually_indexed_properties_entities     4.787%    4.672%    4.892%
  indexing                               query_people_count_multiple_individually_indexed_properties_enti   1.356%    1.269%    1.451%
  large_dataset                          bench_query_population_indexed_property_entities                   2.378%    2.061%    2.867%
  large_dataset                          bench_query_population_derived_property_entities                  12.208%   11.683%   12.723%
  large_dataset                          bench_match_entity                                                15.638%   15.406%   15.886%
  sample_entity_whole_population         10000                                                              0.475%    0.187%    0.748%
  sample_entity_whole_population         100000                                                             0.683%    0.441%    0.915%
  sample_entity_multi_property_indexed   10000                                                              2.536%    2.196%    3.094%
  sample_entity_multi_property_indexed   100000                                                             2.029%    1.462%    2.642%
  sample_entity_multi_property_indexed   1000                                                               1.873%    1.408%    2.196%

Improvements:
  Group                                  Bench                                                              Change  CI Lower  CI Upper
  -------------------------------------  ----------------------------------------------------------------  -------  --------  --------
  sampling                               sampling_multiple_l_reservoir_entities                            -2.811%   -2.851%   -2.773%
  sampling                               sampling_single_known_length_entities                             -1.270%   -1.722%   -0.836%
  sampling                               sampling_single_l_reservoir_entities                              -4.600%   -4.710%   -4.516%
  sample_entity_single_property_indexed  10000                                                             -2.463%   -3.048%   -1.834%
  sample_entity_single_property_indexed  100000                                                            -0.990%   -1.492%   -0.631%
  sample_entity_single_property_indexed  1000                                                              -2.866%   -3.058%   -2.701%
  indexing                               with_query_results_indexed_multi-property_entities                -6.991%   -7.254%   -6.528%
  indexing                               with_query_results_multiple_individually_indexed_properties_enti  -0.230%   -0.333%   -0.125%
  indexing                               query_people_single_indexed_property_entities                     -5.271%   -5.381%   -5.176%
  indexing                               query_people_count_indexed_multi-property_entities                -8.901%   -9.071%   -8.700%
  indexing                               query_people_indexed_multi-property_entities                      -7.598%   -7.696%   -7.485%
  indexing                               with_query_results_single_indexed_property_entities               -2.443%   -3.127%   -1.763%
  large_dataset                          bench_query_population_property_entities                          -2.297%   -2.561%   -1.975%
  large_dataset                          bench_query_population_multi_indexed_entities                     -2.438%   -2.760%   -1.933%
  large_dataset                          bench_query_population_multi_unindexed_entities                   -9.781%  -10.682%   -9.025%

Unchanged:
  Group                                  Bench                                                              Change  CI Lower  CI Upper
  -------------------------------------  ----------------------------------------------------------------  -------  --------  --------
  indexing                               query_people_count_single_indexed_property_entities               -0.896%   -1.481%    0.111%
  large_dataset                          bench_filter_indexed_entity                                        4.260%   -5.489%   14.573%
  large_dataset                          bench_filter_unindexed_entity                                      0.885%   -1.836%    3.573%
  sample_entity_whole_population         1000                                                               0.303%   -0.449%    0.842%

github-actions · 2026-02-11T17:53:25Z

Benchmark Results

Hyperfine

Command	Mean [ms]	Min [ms]	Max [ms]	Relative
`large_sir::baseline`	2.9 ± 0.0	2.8	3.1	1.00
`large_sir::entities`	13.5 ± 0.2	13.3	14.2	4.61 ± 0.11

Criterion

Regressions:
  Group                                  Bench                                                               Change  CI Lower  CI Upper
  -------------------------------------  ----------------------------------------------------------------  --------  --------  --------
  sampling                               sampling_multiple_l_reservoir_entities                              3.691%    3.494%    3.876%
  sampling                               sampling_multiple_known_length_entities                             0.114%    0.010%    0.229%
  sample_entity_single_property_indexed  10000                                                               2.650%    2.396%    3.020%
  sample_entity_single_property_indexed  100000                                                              1.099%    0.551%    1.528%
  sample_entity_single_property_indexed  1000                                                                1.816%    1.361%    2.289%
  indexing                               query_people_multiple_individually_indexed_properties_entities      0.374%    0.274%    0.472%
  indexing                               query_people_count_multiple_individually_indexed_properties_enti    3.292%    3.172%    3.401%
  indexing                               with_query_results_multiple_individually_indexed_properties_enti    4.993%    4.641%    5.351%
  indexing                               query_people_single_indexed_property_entities                       7.707%    4.683%   10.920%
  large_dataset                          bench_query_population_property_entities                            4.218%    2.174%    6.478%
  large_dataset                          bench_query_population_indexed_property_entities                   12.570%   12.116%   12.946%
  large_dataset                          bench_query_population_derived_property_entities                    0.646%    0.262%    1.041%
  large_dataset                          bench_query_population_multi_indexed_entities                       7.287%    7.079%    7.511%
  large_dataset                          bench_match_entity                                                 11.413%   11.159%   11.846%
  sample_entity_whole_population         1000                                                                1.392%    1.082%    1.910%
  sample_entity_multi_property_indexed   10000                                                               0.430%    0.144%    0.851%
  sample_entity_multi_property_indexed   100000                                                              0.469%    0.176%    0.777%
  sample_entity_multi_property_indexed   1000                                                                0.840%    0.528%    1.217%

Improvements:
  Group                                  Bench                                                               Change  CI Lower  CI Upper
  -------------------------------------  ----------------------------------------------------------------  --------  --------  --------
  sampling                               sampling_single_known_length_entities                              -0.295%   -0.600%   -0.039%
  sampling                               sampling_single_l_reservoir_entities                               -5.126%   -5.355%   -4.900%
  indexing                               with_query_results_indexed_multi-property_entities                 -3.752%   -3.948%   -3.542%
  indexing                               query_people_count_indexed_multi-property_entities                 -5.871%   -6.223%   -5.411%
  indexing                               query_people_indexed_multi-property_entities                      -20.441%  -20.572%  -20.313%
  large_dataset                          bench_query_population_multi_unindexed_entities                    -5.222%   -6.458%   -4.117%
  sample_entity_whole_population         10000                                                              -3.105%   -3.622%   -2.485%
  sample_entity_whole_population         100000                                                             -2.043%   -2.466%   -1.641%

Unchanged:
  Group                                  Bench                                                               Change  CI Lower  CI Upper
  -------------------------------------  ----------------------------------------------------------------  --------  --------  --------
  indexing                               query_people_count_single_indexed_property_entities                -0.232%   -0.612%    0.021%
  indexing                               with_query_results_single_indexed_property_entities                 0.093%   -0.215%    0.326%
  large_dataset                          bench_filter_indexed_entity                                        -1.033%  -12.047%   11.510%
  large_dataset                          bench_filter_unindexed_entity                                      -3.964%   -8.578%    0.957%

k88hudson-cfa

There are some security issues here I'm concerned about, if this is the approach you're taking it's critical to maintain principle of least privilege on giving the action permissions. In terms of the artifacts, you could consider this: https://docs.github.com/en/actions/tutorials/store-and-share-data

.github/workflows/bench-compare.yaml

scripts/bench_results.mjs

github-actions · 2026-02-12T15:17:43Z

Benchmark Results

Hyperfine

Command	Mean [ms]	Min [ms]	Max [ms]	Relative
`large_sir::baseline`	2.9 ± 0.1	2.8	3.1	1.00
`large_sir::entities`	13.2 ± 0.2	12.9	13.7	4.59 ± 0.10

Criterion

Regressions:
  Group                                  Bench                                                               Change  CI Lower  CI Upper
  -------------------------------------  ----------------------------------------------------------------  --------  --------  --------
  sampling                               sampling_multiple_l_reservoir_entities                              2.530%    2.266%    2.716%
  sampling                               sampling_single_known_length_entities                               0.552%    0.186%    0.946%
  sampling                               sampling_single_l_reservoir_entities                                3.151%    2.937%    3.306%
  sampling                               sampling_multiple_known_length_entities                             0.234%    0.152%    0.304%
  sample_entity_single_property_indexed  100000                                                              4.720%    4.421%    5.121%
  indexing                               query_people_multiple_individually_indexed_properties_entities      2.006%    1.909%    2.130%
  indexing                               query_people_count_multiple_individually_indexed_properties_enti    1.387%    1.261%    1.505%
  indexing                               with_query_results_multiple_individually_indexed_properties_enti    1.518%    1.335%    1.653%
  indexing                               query_people_count_indexed_multi-property_entities                  0.713%    0.297%    1.320%
  large_dataset                          bench_query_population_derived_property_entities                    4.075%    3.713%    4.469%
  large_dataset                          bench_match_entity                                                  8.159%    7.747%    8.453%
  sample_entity_whole_population         1000                                                                0.378%    0.214%    0.555%
  sample_entity_multi_property_indexed   10000                                                               1.398%    1.242%    1.561%

Improvements:
  Group                                  Bench                                                               Change  CI Lower  CI Upper
  -------------------------------------  ----------------------------------------------------------------  --------  --------  --------
  sample_entity_single_property_indexed  10000                                                              -0.520%   -0.711%   -0.347%
  sample_entity_single_property_indexed  1000                                                               -0.774%   -1.100%   -0.528%
  indexing                               with_query_results_indexed_multi-property_entities                 -2.421%   -2.756%   -2.148%
  indexing                               query_people_single_indexed_property_entities                     -15.960%  -18.085%  -13.685%
  indexing                               query_people_indexed_multi-property_entities                       -7.486%   -8.735%   -6.212%
  large_dataset                          bench_query_population_property_entities                           -1.733%   -2.063%   -1.262%
  large_dataset                          bench_query_population_indexed_property_entities                   -0.590%   -1.093%   -0.123%
  large_dataset                          bench_query_population_multi_unindexed_entities                    -7.215%   -7.394%   -7.027%
  sample_entity_whole_population         10000                                                              -1.995%   -2.375%   -1.705%
  sample_entity_whole_population         100000                                                             -0.577%   -0.962%   -0.299%

Unchanged:
  Group                                  Bench                                                               Change  CI Lower  CI Upper
  -------------------------------------  ----------------------------------------------------------------  --------  --------  --------
  indexing                               query_people_count_single_indexed_property_entities                 0.107%   -0.211%    0.364%
  indexing                               with_query_results_single_indexed_property_entities                -0.035%   -0.179%    0.108%
  large_dataset                          bench_filter_indexed_entity                                        -0.377%  -11.167%   13.015%
  large_dataset                          bench_query_population_multi_indexed_entities                      -0.269%   -0.623%    0.017%
  large_dataset                          bench_filter_unindexed_entity                                      -0.844%   -5.397%    4.210%
  sample_entity_multi_property_indexed   100000                                                              0.834%   -0.108%    1.535%
  sample_entity_multi_property_indexed   1000                                                                0.306%   -0.086%    0.617%

github-actions · 2026-02-12T16:21:42Z

Benchmark Results

Hyperfine

Command	Mean [ms]	Min [ms]	Max [ms]	Relative
`large_sir::baseline`	3.0 ± 0.1	2.9	3.1	1.00
`large_sir::entities`	14.4 ± 0.2	14.1	15.1	4.88 ± 0.11

Criterion

Regressions:
  Group                                  Bench                                                               Change  CI Lower  CI Upper
  -------------------------------------  ----------------------------------------------------------------  --------  --------  --------
  sampling                               sampling_multiple_l_reservoir_entities                             11.749%   10.819%   12.861%
  sampling                               sampling_single_l_reservoir_entities                                5.973%    5.070%    7.075%
  sampling                               sampling_multiple_known_length_entities                             0.240%    0.088%    0.427%
  indexing                               query_people_multiple_individually_indexed_properties_entities      2.922%    2.126%    3.938%
  indexing                               query_people_count_multiple_individually_indexed_properties_enti    4.580%    4.190%    5.051%
  large_dataset                          bench_query_population_derived_property_entities                    1.696%    1.242%    2.284%
  large_dataset                          bench_query_population_multi_unindexed_entities                     2.253%    0.424%    4.066%
  large_dataset                          bench_match_entity                                                  8.825%    8.097%    9.691%
  sample_entity_whole_population         1000                                                                0.417%    0.024%    0.862%
  sample_entity_multi_property_indexed   10000                                                               1.700%    1.242%    2.263%
  sample_entity_multi_property_indexed   100000                                                              1.223%    0.162%    2.457%
  sample_entity_multi_property_indexed   1000                                                                0.685%    0.031%    1.305%

Improvements:
  Group                                  Bench                                                               Change  CI Lower  CI Upper
  -------------------------------------  ----------------------------------------------------------------  --------  --------  --------
  sampling                               sampling_single_known_length_entities                              -8.536%   -9.024%   -7.990%
  sample_entity_single_property_indexed  10000                                                              -3.344%   -3.632%   -2.918%
  sample_entity_single_property_indexed  100000                                                             -4.899%   -6.044%   -4.034%
  sample_entity_single_property_indexed  1000                                                               -3.458%   -3.936%   -2.753%
  indexing                               with_query_results_indexed_multi-property_entities                 -0.631%   -1.016%   -0.161%
  indexing                               with_query_results_multiple_individually_indexed_properties_enti   -0.672%   -1.184%   -0.179%
  indexing                               query_people_single_indexed_property_entities                      -4.350%   -6.708%   -2.019%
  indexing                               query_people_indexed_multi-property_entities                      -13.837%  -14.208%  -13.427%
  large_dataset                          bench_query_population_property_entities                           -2.057%   -3.990%   -0.087%
  large_dataset                          bench_query_population_indexed_property_entities                   -0.666%   -1.182%   -0.269%
  large_dataset                          bench_query_population_multi_indexed_entities                      -8.164%   -9.250%   -7.069%
  sample_entity_whole_population         10000                                                              -0.821%   -0.991%   -0.650%

Unchanged:
  Group                                  Bench                                                               Change  CI Lower  CI Upper
  -------------------------------------  ----------------------------------------------------------------  --------  --------  --------
  indexing                               query_people_count_indexed_multi-property_entities                  0.090%   -1.077%    1.425%
  indexing                               query_people_count_single_indexed_property_entities                -0.416%   -1.454%    0.422%
  indexing                               with_query_results_single_indexed_property_entities                 0.704%   -0.291%    1.489%
  large_dataset                          bench_filter_indexed_entity                                        10.820%   -2.581%   24.847%
  large_dataset                          bench_filter_unindexed_entity                                       4.388%   -0.923%    9.797%
  sample_entity_whole_population         100000                                                             -0.312%   -0.767%    0.189%

k88hudson-cfa

R+ with a follow-up: I didn't do thorough comments on the front-end code, but please fix the innerHTML with the unescaped html (in general be careful about using innerHTML)

Some other minor notes that are optional but recommended

.github/workflows/bench-compare.yaml

scripts/index.html

scripts/bench_results.js

github-actions · 2026-02-16T16:45:49Z

Benchmark Results

Hyperfine

Command	Mean [ms]	Min [ms]	Max [ms]	Relative
`large_sir::baseline`	3.0 ± 0.0	2.9	3.1	1.00
`large_sir::entities`	12.6 ± 0.2	12.4	13.1	4.18 ± 0.08

Criterion

Regressions:
  Group                                  Bench                                                               Change  CI Lower  CI Upper
  -------------------------------------  ----------------------------------------------------------------  --------  --------  --------
  sample_entity_single_property_indexed  100000                                                             24.157%   23.433%   24.830%
  indexing                               with_query_results_multiple_individually_indexed_properties_enti    6.526%    6.300%    6.738%
  indexing                               query_people_count_single_indexed_property_entities                 0.647%    0.473%    0.829%
  indexing                               query_people_multiple_individually_indexed_properties_entities      3.344%    3.023%    3.572%
  indexing                               query_people_count_multiple_individually_indexed_properties_enti    0.912%    0.808%    1.017%
  indexing                               query_people_single_indexed_property_entities                      32.506%   32.285%   32.672%
  sample_entity_multi_property_indexed   10000                                                              11.982%   10.957%   12.831%
  sample_entity_multi_property_indexed   100000                                                             22.421%   21.785%   23.077%
  large_dataset                          bench_match_entity                                                 25.164%   24.760%   25.750%
  large_dataset                          bench_query_population_multi_indexed_entities                       2.379%    2.057%    2.718%
  large_dataset                          bench_query_population_derived_property_entities                    2.606%    2.137%    3.076%
  large_dataset                          bench_query_population_indexed_property_entities                    0.785%    0.261%    1.207%
  sampling                               sampling_single_known_length_entities                               1.339%    0.878%    1.876%
  sampling                               sampling_multiple_known_length_entities                           895.422%  893.813%  896.602%

Improvements:
  Group                                  Bench                                                               Change  CI Lower  CI Upper
  -------------------------------------  ----------------------------------------------------------------  --------  --------  --------
  sample_entity_single_property_indexed  10000                                                              -4.068%   -4.815%   -3.457%
  sample_entity_single_property_indexed  1000                                                               -1.766%   -2.116%   -1.391%
  indexing                               with_query_results_indexed_multi-property_entities                 -2.085%   -2.772%   -1.592%
  indexing                               query_people_indexed_multi-property_entities                       -9.507%   -9.998%   -8.831%
  indexing                               with_query_results_single_indexed_property_entities                -3.260%   -3.757%   -2.935%
  indexing                               query_people_count_indexed_multi-property_entities                 -2.376%   -2.791%   -2.090%
  sample_entity_multi_property_indexed   1000                                                               -1.790%   -3.442%   -0.698%
  large_dataset                          bench_query_population_property_entities                           -2.007%   -2.290%   -1.633%
  large_dataset                          bench_query_population_multi_unindexed_entities                    -6.918%   -7.192%   -6.593%
  sampling                               sampling_multiple_l_reservoir_entities                             -9.843%   -9.984%   -9.700%
  sampling                               sampling_single_l_reservoir_entities                               -3.370%   -3.461%   -3.282%
  sample_entity_whole_population         10000                                                             -13.839%  -14.043%  -13.635%
  sample_entity_whole_population         100000                                                            -14.681%  -15.028%  -14.348%
  sample_entity_whole_population         1000                                                               -9.443%   -9.984%   -8.799%

Unchanged:
  Group                                  Bench                                                               Change  CI Lower  CI Upper
  -------------------------------------  ----------------------------------------------------------------  --------  --------  --------
  large_dataset                          bench_filter_indexed_entity                                         2.235%  -11.444%   16.117%
  large_dataset                          bench_filter_unindexed_entity                                       2.254%   -2.659%    7.325%

github-actions · 2026-02-16T17:08:25Z

Benchmark Results

Hyperfine

Command	Mean [ms]	Min [ms]	Max [ms]	Relative
`large_sir::baseline`	3.0 ± 0.0	2.9	3.1	1.00
`large_sir::entities`	13.5 ± 0.2	13.3	13.9	4.54 ± 0.09

Criterion

Regressions:
  Group                                  Bench                                                               Change  CI Lower  CI Upper
  -------------------------------------  ----------------------------------------------------------------  --------  --------  --------
  indexing                               query_people_indexed_multi-property_entities                        4.627%    4.309%    4.843%
  indexing                               query_people_multiple_individually_indexed_properties_entities      2.631%    2.487%    2.776%
  indexing                               query_people_count_multiple_individually_indexed_properties_enti    1.599%    1.421%    1.754%
  large_dataset                          bench_query_population_derived_property_entities                    0.743%    0.129%    1.404%
  sampling                               sampling_multiple_known_length_entities                           868.915%  867.139%  870.116%

Improvements:
  Group                                  Bench                                                               Change  CI Lower  CI Upper
  -------------------------------------  ----------------------------------------------------------------  --------  --------  --------
  sample_entity_single_property_indexed  10000                                                              -7.018%   -7.214%   -6.783%
  sample_entity_single_property_indexed  100000                                                             -7.051%   -7.733%   -6.476%
  sample_entity_single_property_indexed  1000                                                               -6.295%   -6.747%   -5.754%
  indexing                               with_query_results_multiple_individually_indexed_properties_enti   -2.955%   -3.279%   -2.378%
  indexing                               query_people_count_single_indexed_property_entities                -2.550%   -3.038%   -2.140%
  indexing                               with_query_results_single_indexed_property_entities                -2.812%   -3.354%   -2.405%
  indexing                               query_people_single_indexed_property_entities                      -0.327%   -0.587%   -0.158%
  sample_entity_multi_property_indexed   10000                                                              -1.698%   -2.190%   -1.246%
  sample_entity_multi_property_indexed   100000                                                             -1.184%   -1.629%   -0.890%
  sample_entity_multi_property_indexed   1000                                                               -1.849%   -2.307%   -1.197%
  large_dataset                          bench_query_population_multi_unindexed_entities                   -10.065%  -11.799%   -8.425%
  large_dataset                          bench_query_population_indexed_property_entities                   -0.271%   -0.496%   -0.027%
  sampling                               sampling_multiple_l_reservoir_entities                             -9.001%   -9.113%   -8.892%
  sampling                               sampling_single_l_reservoir_entities                               -2.209%   -2.321%   -2.122%
  sample_entity_whole_population         10000                                                             -10.686%  -11.105%  -10.287%
  sample_entity_whole_population         100000                                                            -10.648%  -11.108%  -10.149%
  sample_entity_whole_population         1000                                                              -10.529%  -10.924%  -10.012%

Unchanged:
  Group                                  Bench                                                               Change  CI Lower  CI Upper
  -------------------------------------  ----------------------------------------------------------------  --------  --------  --------
  indexing                               with_query_results_indexed_multi-property_entities                 -0.307%   -0.964%    0.371%
  indexing                               query_people_count_indexed_multi-property_entities                 -0.303%   -0.749%    0.033%
  large_dataset                          bench_filter_indexed_entity                                         0.543%  -11.548%   15.034%
  large_dataset                          bench_query_population_property_entities                           -0.093%   -0.326%    0.089%
  large_dataset                          bench_filter_unindexed_entity                                       1.081%   -3.654%    5.863%
  large_dataset                          bench_match_entity                                                  0.093%   -0.318%    0.458%
  large_dataset                          bench_query_population_multi_indexed_entities                       0.175%   -0.074%    0.419%
  sampling                               sampling_single_known_length_entities                              -0.040%   -0.551%    0.356%

github-actions · 2026-02-16T17:45:26Z

Benchmark Results

Hyperfine

Command	Mean [ms]	Min [ms]	Max [ms]	Relative
`large_sir::baseline`	3.0 ± 0.0	2.9	3.1	1.00
`large_sir::entities`	13.1 ± 0.3	12.7	14.5	4.36 ± 0.13

Criterion

Regressions:
  Group                                    Bench                                               Change  CI Lower  CI Upper
  ---------------------------------------  ------------------------------------------------  --------  --------  --------
  sample_entity_multi_property_indexed     10000                                               0.633%    0.210%    1.098%
  sample_entity_multi_property_indexed     100000                                              0.882%    0.312%    1.446%
  large_dataset                            bench_query_population_multi_indexed_entities       0.689%    0.221%    1.273%
  large_dataset                            bench_query_population_multi_unindexed_entities     4.568%    3.076%    6.185%
  sampling                                 sampling_multiple_l_reservoir_entities              2.293%    1.812%    2.788%
  sampling                                 sampling_single_l_reservoir_entities                0.211%    0.057%    0.385%
  sampling                                 sampling_multiple_known_length_entities             0.733%    0.316%    1.321%

Improvements:
  Group                                    Bench                                               Change  CI Lower  CI Upper
  ---------------------------------------  ------------------------------------------------  --------  --------  --------
  sample_entity_single_property_indexed    100000                                             -0.557%   -1.031%   -0.221%
  sample_entity_single_property_indexed    1000                                               -0.570%   -1.005%   -0.216%
  sample_entity_single_property_unindexed  10000                                             -21.528%  -21.747%  -21.324%
  sample_entity_single_property_unindexed  100000                                             -0.334%   -0.657%   -0.067%
  sample_entity_single_property_unindexed  1000                                              -14.483%  -16.400%  -12.428%
  large_dataset                            bench_query_population_property_entities           -0.402%   -0.914%   -0.023%
  large_dataset                            bench_query_population_indexed_property_entities   -1.233%   -1.689%   -0.913%
  sampling                                 sampling_multiple_unindexed_entities               -3.173%   -3.467%   -2.822%
  sampling                                 sampling_single_unindexed_entities                 -0.821%   -1.075%   -0.642%
  sample_entity_whole_population           10000                                              -1.409%   -1.974%   -0.846%
  sample_entity_whole_population           1000                                               -0.875%   -1.322%   -0.555%

Unchanged:
  Group                                    Bench                                               Change  CI Lower  CI Upper
  ---------------------------------------  ------------------------------------------------  --------  --------  --------
  sample_entity_single_property_indexed    10000                                              -1.066%   -2.420%    0.176%
  sample_entity_multi_property_indexed     1000                                                0.239%   -0.241%    0.573%
  large_dataset                            bench_filter_indexed_entity                        -0.443%  -12.332%   14.045%
  large_dataset                            bench_filter_unindexed_entity                      -0.308%   -5.003%    4.502%
  large_dataset                            bench_match_entity                                 -0.133%   -0.351%    0.084%
  large_dataset                            bench_query_population_derived_property_entities    0.327%   -0.160%    0.709%
  sampling                                 sampling_single_known_length_entities              -0.344%   -2.039%    0.810%
  sample_entity_whole_population           100000                                              0.444%   -0.087%    0.937%

cdc-as81 added 5 commits February 10, 2026 15:23

chore: add benchmark history

00efc72

update the index.html file

61cd894

fix index.html

199bfea

fix Hyperfine pr comment

cdd21b8

updated bench history scripts

90d74c5

cdc-as81 requested a review from k88hudson-cfa February 11, 2026 17:35

cdc-as81 linked an issue Feb 11, 2026 that may be closed by this pull request

investigate using benchmark-action to track history of benchmarks for ixa #717

Closed

k88hudson-cfa requested changes Feb 12, 2026

View reviewed changes

.github/workflows/bench-compare.yaml Outdated Show resolved Hide resolved

.github/workflows/bench-compare.yaml Outdated Show resolved Hide resolved

.github/workflows/bench-compare.yaml Outdated Show resolved Hide resolved

scripts/bench_results.mjs Show resolved Hide resolved

update bench-compare

8a45ca1

github-actions bot added a commit that referenced this pull request Feb 12, 2026

Update bench-history.json (PR #765 @ 8a45ca1)

6511d6b

updated bench-compare

a0dcc7f

github-actions bot added a commit that referenced this pull request Feb 12, 2026

Update bench-history.json (PR #765 @ a0dcc7f)

a887b8f

cdc-as81 requested a review from k88hudson-cfa February 12, 2026 16:25

k88hudson-cfa approved these changes Feb 16, 2026

View reviewed changes

fix comments

5cff163

github-actions bot added a commit that referenced this pull request Feb 16, 2026

Update bench-history.json (PR #765 @ 5cff163)

5ac1778

Merge branch 'main' into cdc-as81-benchmarks-history

17fe1ae

github-actions bot added a commit that referenced this pull request Feb 16, 2026

Update bench-history.json (PR #765 @ 17fe1ae)

df9df19

Merge branch 'main' into cdc-as81-benchmarks-history

4b1c368

github-actions bot added a commit that referenced this pull request Feb 16, 2026

Update bench-history.json (PR #765 @ 4b1c368)

e3bbc44

cdc-as81 merged commit 6ca5dbd into main Feb 16, 2026
5 of 6 checks passed

cdc-as81 deleted the cdc-as81-benchmarks-history branch February 16, 2026 19:57

Conversation

cdc-as81 commented Feb 11, 2026

Uh oh!

github-actions bot commented Feb 11, 2026

Benchmark Results

Hyperfine

Criterion

Uh oh!

github-actions bot commented Feb 11, 2026

Benchmark Results

Hyperfine

Criterion

Uh oh!

k88hudson-cfa left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

github-actions bot commented Feb 12, 2026

Benchmark Results

Hyperfine

Criterion

Uh oh!

github-actions bot commented Feb 12, 2026

Benchmark Results

Hyperfine

Criterion

Uh oh!

k88hudson-cfa left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

github-actions bot commented Feb 16, 2026

Benchmark Results

Hyperfine

Criterion

Uh oh!

github-actions bot commented Feb 16, 2026

Benchmark Results

Hyperfine

Criterion

Uh oh!

github-actions bot commented Feb 16, 2026

Benchmark Results

Hyperfine

Criterion

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants